Presentation: Tweet"Counting events reliably in real-time with storm and riak"
At Marktplaats I am responsible for the pay-per-click advertisement product called Admarkt. Our customers can place ads which are then viewed by visitors of our website which is one of the largest in the Netherlands. The placement of the ads, the billing and ultimately our revenue depend highly on how quickly and accurately we can keep track of changes and propagate them through the system.
In this presentation I am going to describe how we use a combination of Twitters' storm, bashos' riak and some simple but clever data structures to count tens to hundreds of millions of events per day in real time while being able to scale horizontally, be robust against failures and survive performance peaks.